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(1) Real Party in Interest 

The examiner has no comment on the statement, or lack of statement, identifying 
by name the real party in interest in the brief. 

(2) Related Appeals and Interferences 

The appellant's statement of the related appeals and interferences contained in 
the brief is correct. The examiner is not aware of any related appeals, interferences, or 
judicial proceedings which will directly affect or be directly affected by or have a bearing 
on the Board's decision in the pending appeal. 

(3) Status of Claims 

The following is a list of claims that are rejected and pending in the application: 
Claims 1 , 2, 4-22, 25-37, and 40-47. 

(4) Status of Amendments After Final 

The examiner has no comment on the appellant's statement of the status of 
amendments after final rejection contained in the brief. 

(5) Summary of Claimed Subject Matter 

The examiner has no comment on the summary of claimed subject matter 
contained in the brief. 
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(6) Grounds of Rejection to be Reviewed on Appeal 

The examiner has no comment on the appellant's statement on the grounds of 
rejection to be reviewed on appeal. Every ground of rejection set forth in the Office 
action from which the appeal is taken (as modified by any advisory actions) is being 
maintained by the examiner except for the grounds of rejection (if any) listed under the 
subheading "WITHDRAWN REJECTIONS." New grounds of rejections (if any) are 
provided under the subheading "NEW GROUNDS OF REJECTION." 

(7) Claims Appendix 

The examiner has no comment on the copy of the appealed claims contained in 
the Appendix to the appellant's brief. 

(8) Evidence Relied Upon 

The following is a listing of the prior art of record relied upon in the rejection of 
claims under appeal. 

US 2003/01 561 38 A1 VRONAY ET AL 8-2003 

"The Complete Idiot's Guide to TEMPLE 5-1999 
Microsoft Outlook 2000" 

US 2004/01 251 50 A1 ADCOCK ET AL 7-2004 

US 2004/01 09025 A1 HULLOT ET AL 6-2004 



(9) Grounds of Rejection 
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The following ground(s) of rejection are applicable to the appealed claims: 

Claim Rejections - 35 USC <$ 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claim 1 , 2, 4-22, 26-37, and 40-47 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Vronay et al (Pub. No. US 2003/0156138 A1) in view of Temple 
("The Complete Idiot's Guide to Microsoft Outlook 2000", May 1999), and further in view 
of Adcock et al (Pub. No. US 2004/0125150 A1). 

Claims 1, 2, 4-19, 42 

Regarding claim 1 , Vronay teaches the claim comprising a computer readable 
storage medium; and computer-readable program instructions embodied in the medium, 
the computer-readable program instructions including: first instructions for receiving 
manual entry of events and generating a calendar view that represents time in calendar 
format and visually associates events with respective periods of time, the calendar view 
including at least one manually entered event scheduled at a future time, by disclosing a 
calendar-based user interface that improves user accessibility of information from a 
computer [paragraph 1]. The calendar user interface system would provide and include 
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standard calendar operations, similar to the calendar in numerous conventional 
calendar programs [paragraph 35]. Conventional computer calendars allow for user- 
specified appointments, meetings, etc. to be added or entered manually [paragraph 5]. 
These events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Vronay teaches wherein at least one of the events is created and represented in 
the calendar view independent of any digital media files, by disclosing that events are 
marked on the calendar to allow users to easily track important events [paragraphs 39- 
42]. 

Vronay teaches second instructions for generating a media view that provides 
access to digital media files and associates digital media files with a period of time, by 
disclosing simultaneously presenting the calendar view with a list of times and 
corresponding accessible media [paragraph 65, figure 11]. 

Vronay does not expressly teach the calendar view including at least one 
manually entered past event. Temple discloses adding appointments to a calendar in 
Microsoft Outlook 2000 [page 196, Adding an Appointment]. Users can enter the date 
and time for an appointment, which may be a past date [page 198, When?; page 200, 
Other Ways to Add Appointments]. Since Vronay discloses providing and including 
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standard calendar operations, similar to the calendar in numerous conventional 
calendar programs [Vronay, paragraph 35], it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to allow users to manual 
enter an event in the past, as taught by Temple. This would provide added flexibility in 
scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
Vronay does not expressly teach wherein the first and second instructions operate 
concurrently to generate a timeline view that combines the calendar view and the media 
view such that multiple media file representations are enabled to be displayed in a 
corresponding period of time segment of the timeline view along with a text identification 
of an event associated with the multiple media file representations. Adcock discloses a 
calendar based graphical user interface for displaying digital images [paragraph 1] 
Graphical objects representing digital images are displayed within a calendar view 
having a timeline [figures 4, 5] Digital images are accessible for detailed viewing or 
editing by selection of a displayed graphical object in the calendar [paragraph 35]. 
Images for an event may be grouped together [paragraph 37] and associated with an 
event identifier [paragraph 40] Additionally, event groups in the graphical object display 
window may be separated/identified by a placeholder containing information for the 
associated event [paragraph 42] This allows users to more efficiently browse images 
[paragraph 3] Since Vronay discloses the need to better locate and retrieve computer 
information such as files, it would have been obvious to one of ordinary skill in the art at 
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the time the invention was made to use the interface of Adcock for browsing the 
calendar-based interface of Vronay. This would allow users to more efficiently browse 
images. 

Regarding claim 2, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the second instructions for generating the media view associate digital media 
files with event information, by disclosing associated digital images with events [Adcock, 
paragraph 37]. 

Regarding claim 4, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the first and second instructions operate concurrently to generate, in the 
timeline view, a timeline associated with the media view, by disclosing [Adcock, figures 
4, 5]. 

Regarding claim 5, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the first and second instructions operate concurrently to generate, in the 
timeline view, a timeline associated with the calendar view and the media view, by 
disclosing [Adcock, figures 4, 5]. 

Regarding claim 6, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein said first instructions are configured to receive manual entry of events and store 
metadata respectively associated with the events, by disclosing that metadata may be 
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associated with certain events based on computer activity [Vronay, paragraph 37]. 
Information stored in a calendar system database is utilized as well as information 
determined by similarity and chunking system to display different levels of time-based 
information relating the user computer activities and files [Vronay, paragraph 33]. 

Vronay, Temple, and Adcock disclose wherein the first and second instructions 
operate concurrently to correlate respective metadata information of the media files and 
calendar events, by disclosing displaying digital images based on time the digital image 
was created [Adcock, paragraph 32]. 

Regarding claim 7, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein said first instructions are configured to receive manual entry of events and store 
metadata respectively associated with the events, by disclosing that metadata may be 
associated with certain events based on computer activity [Vronay, paragraph 37]. 
Information stored in a calendar system database is utilized as well as information 
determined by similarity and chunking system to display different levels of time-based 
information relating the user computer activities and files [Vronay, paragraph 33]. 

Vronay, Temple, and Adcock teach wherein the first and second instructions 
operate concurrently to combine previously distinct metadata information of one of the 
media files and a relevant calendar event, respectively, the relevant calendar event 
being manually created and represented in the calendar view independent of any digital 
media files, by disclosing allowing the user to group digital images with events [Adcock, 
paragraph 39]. 
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Regarding claim 8, Vronay, Temple, and Adcock disclose the product of claim 7, 
wherein the first and second instructions operate concurrently to store the combined 
metadata information into the metadata information of the media file, by disclosing that 
metadata can be added to the files [Vronay, paragraphs 60-61]. 

Regarding claim 9, Vronay, Temple, and Adcock discloses the product of claim 8, 
wherein the first and second instructions operate concurrently to display, in the media 
view, an item of information in the metadata as a title for a group of media files having 
the same metadata as used in the title, by disclosing searching for and displaying 
matched items under a title representative of the metadata searched for such as 'Dad' 
[Vronay, paragraph 55, figure 7] or a specific date [Vronay, figure 1 1; Adcock, 
paragraph 36]. 

Regarding claim 10, Vronay, Temple, and Adcock disclose the product of claim 
9, further comprising third instructions for searching the calendar view and the media 
view in terms of time period, by disclosing searching based on dates [Vronay, figure 5; 
Adcock, paragraph 36] 

Regarding claim 1 1 , Vronay, Temple, and Adcock disclose the product of claim 
9, further comprising third instructions for searching the calendar view and the media 



Application/Control Number: 1 0/71 5,1 87 Page 1 0 

Art Unit: 2172 

view in terms of any combination of metadata information, by disclosing searching 
based on various metadata [Vronay, figures 6, 8, 9]. 

Regarding claim 12, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions also generate an indicator for a current time, by 
disclosing providing information visualizations so the user can distinguish between 
different days such as past days, a current day, and future days [Vronay, paragraph 37] 

Regarding claim 13, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions also generate a delineation between past time and future 
time, by disclosing providing information visualizations so the user can distinguish 
between different days such as past days, a current day, and future days [Vronay, 
paragraphs 37-39]. 

Regarding claim 14, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions associate digital media files with a period of time 
based upon information associated with the digital media file, by disclosing including 
information for a computer files such as when the file was created [Vronay, paragraph 
25; Adcock, paragraph 32]. 

Regarding claim 15, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions provide a user a presentation mode to access the 
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digital media files, by disclosing that digital images are accessible for detailed viewing or 
editing by selection of a displayed graphical object [Adcock, paragraph 35]. 

Regarding claim 16, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions generate a media view that associates digital media 
files with a past period of time, by disclosing that the user may modify the date for which 
a digital image is associated [Adcock, paragraph 61] and view a history of a selected 
date [Adcock, paragraph 36]. 

Regarding claim 17, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions generate a calendar view that associates events with 
respective future periods of time, by disclosing that the user may edit the days 
encompassing an event [Adcock, paragraph 39]. 

Regarding claim 18, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions for generating a media view that provides access to 
the media files within a period in time further generates instruction that adjusts a size of 
a period of time view according to the amount of the media files in the period of time, by 
disclosing that calendar views are resized based on the number of digital images 
[Adcock, paragraph 46]. 
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Regarding claim 19, Vronay, Temple, and Adcock disclose the product of claim 
1 8, wherein the second instructions adjust the size of the period of time view so that all 
the media files within a period of time are visible, by disclosing resizing calendar views 
based on the number of digital images [Adcock, paragraph 46; figures 5, 7-12]. 

Regarding claim 42, Vronay, Temple, and Adcock disclose the product of claim 
6, wherein the first and second instructions operate concurrently to automatically 
correlate respective metadata information of the media file and the at least one calendar 
event, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39]. 

Claims 20, 21, 43 

Regarding claim 20, Vronay discloses a method comprising: receiving manual 
input creating an event in a media diary application, by disclosing a calendar-based 
user interface that improves user accessibility of information from a computer 
[paragraph 1]. Users may specify appointments, meetings, etc. [paragraph 5] which are 
marked on the calendar to allow users to easily track important events [paragraph 42]. 

Vronay teaches receiving, in the media diary application, a digital media file 
having metadata associated with the digital media file, the media diary application being 
configured to represent time in calendar format and visually associate events with 
respective periods of time, at least one past event being created and represented in the 
calendar format independent of any digital media files, by disclosing retrieving 
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information about computer files [paragraph 26]. Users may specify appointments, 
meetings, etc. [paragraph 5] which are marked on the calendar, whether in the past or 
future, to allow users to easily track important events [paragraphs 39-42]. 

Vronay teaches providing a user access to the digital media file via a media view 
that displays a representation of the digital media file in connection with a time element 
of the metadata, by disclosing simultaneously presenting the calendar view with a list of 
times and corresponding accessible media [paragraph 65, figure 11]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [Vronay, paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [Vronay, paragraph 5] 
These events are marked on the calendar to allow users to easily track important events 
[Vronay, paragraph 42]. The user computer activities may be in the future [Vronay, 
paragraph 38] The user computer activity must involve manual creation as described in 
[Vronay, paragraphs 35, 5] since if monitoring of events is strictly done without user 
input and based solely on data collection of activities carried out on a computing device, 
there would be no way for the computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [Vronay, paragraphs 39-42], Vronay does not expressly 
teach the calendar view including at least one manually entered past event. Temple 
discloses adding appointments to a calendar in Microsoft Outlook 2000 [page 196, 
Adding an Appointment]. Users can enter the date and time for an appointment, which 
may be a past date [page 198, When?; page 200, Other Ways to Add Appointments]. 
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Since Vronay discloses providing and including standard calendar operations, similar to 
the calendar in numerous conventional calendar programs [Vronay, paragraph 35], it 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to allow users to manual enter an event in the past, as taught by Temple. This 
would provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
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invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

Regarding claim 21 , Vronay, Temple, and Adcock disclose the method of claim 

20, further comprising correlating the metadata in the digital media file with distinct 
event metadata information for an event created and represented in the calendar format 
independent of any digital media files, said correlating being prior to providing a user 
access to the media file via a media view, by disclosing associating events and media 
files [Vronay, paragraph 21] 

Regarding claim 43, Vronay, Temple, and Adcock disclose the method of claim 

21 , wherein said correlating the metadata includes automatically correlating the 
metadata in the digital media file with distinct event metadata event information for an 
event created and represented in the calendar format independent of any digital media 
files, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39] 

Claims 22, 44 

Regarding claim 22, Vronay discloses a method comprising: receiving manual 
input creating an event in a media diary application, by disclosing a calendar-based 
user interface that improves user accessibility of information from a computer 
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[paragraph 1] Users may specify appointments, meetings, etc. [paragraph 5] which are 
marked on the calendar to allow users to easily track important events [paragraph 42] 

Vronay teaches receiving a digital media file having metadata associated with the 
digital media file, by disclosing retrieving information about computer files [paragraph 
26] 

Vronay teaches transmitting the file, automatically, to the media diary application, 
the media diary application associating the digital media file with a period in time based 
on the metadata and being configured to represent time in calendar format and 
associate events with respective periods of time, at least one past event being created 
and represented in the calendar view independent of any digital media files, by 
disclosing associating events and media files [paragraph 21]. Users may specify 
appointments, meetings, etc. [paragraph 5] which are marked on the calendar, whether 
in the past or future, to allow users to easily track important events [paragraphs 39-42] 

Vronay teaches providing a user access to the digital media file via a media view 
that displays a representation of the digital media item in connection with the period of 
time, by disclosing that photos may be searched for and accessed [paragraph 65; figure 
11] 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5] These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42] The user computer activities may be in the future [paragraph 38] The 
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user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
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interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5] 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40] 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42] This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

Regarding claim 44, Vronay, Temple, and Adcock disclose the method of claim 
22, further comprising automatically correlating the metadata in the digital media file 
with distinct metadata associated with a calendar event created and represented in the 
calendar format independent of any digital media files, by disclosing automatically 
associating digital images with an event or date [Adcock, paragraph 39]. 



Claims 26-31, 45 

Regarding claim 26, Vronay teaches a method comprising: storing information 
related to a calendar event in an event file, the calendar event being manually created 
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and visually represented in a calendar independent of any digital media files, by 
disclosing a calendar-based user interface that improves user accessibility of 
information from a computer [paragraph 1] Users may specify appointments, meetings, 
etc. [paragraph 5] which are marked on the calendar to allow users to easily track 
important events [paragraph 42] 

Vronay teaches receiving a digital media file associated with the calendar event, 
by disclosing retrieving information about computer files [paragraph 26] 

Vronay teaches correlating the digital media file with the information in the event 
file, by disclosing utilizing information stored in a calendar system database as well as 
information determined by similarity and chunking system to display different levels of 
time-based information relating the user computer activities and files [paragraph 33] 

Vronay teaches creating an accessible representation of the digital media file and 
at least a portion of the correlated information in the event file in a media view, by 
disclosing displaying visualizations to distinguish events [paragraphs 37-43] Photos 
may be searched for and accessed [paragraphs 48, 65]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5] These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42] The user computer activities may be in the future [paragraph 38] The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
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collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
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Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40] 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42] This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

Regarding claim 27, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the storing information related to a calendar event in an event file further 
comprises storing information related to a calendar event in an event file associated 
with a calendar planner of a media diary, by disclosing creating events for a calendar- 
based interface [Vronay, paragraph 5] 

Regarding claim 28, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the creating an accessible representation of the digital media file and at 
least a portion of the correlated information in the event file further comprises creating, 
in a media view of the media diary, an accessible representation of the digital media file 
and at least a portion of the correlated information in the event file, by disclosing 
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displaying visualizations to distinguish events [Vronay, paragraphs 37-43]. Photos may 
be searched for and accessed [Vronay, paragraphs 48, 65]. 

Regarding claim 29, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the storing information related to a calendar event in an event file further 
comprises storing date and event title information related to a calendar event in an 
event file, by disclosing distinguishing between events [Vronay, paragraph 37]. 

Regarding claim 30, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the correlating the digital media file with the information in the event file 
further comprises correlating metadata in the digital media file with date information in 
the event file, by disclosing associating computer files with events [Vronay, paragraphs 
33-35] 

Regarding claim 31 , Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the correlating the digital media file with the information in the event file 
further comprises correlating metadata in the digital media file with distinct metadata 
information in the event file, by disclosing associating computer files with events 
[Vronay, paragraphs 33-35]. 

Regarding claim 45, Vronay, Temple, and Adcock disclose the method of claim 
30, wherein the correlating the digital media file with the information in the event file 
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includes automatically correlating the digital media file with the information in the event 
file, by disclosing automatically integrating time-based information with metadata 
tagging [Vronay, paragraph 6]. 

Claims 32-36, 46 

Regarding claim 32, Vronay discloses a method comprising: receiving a media 
file having associated metadata information, by disclosing retrieving information about 
computer files [paragraph 26]. 

Vronay teaches correlating the metadata information with calendar event 
information relating to a calendared event created manually and visually represented in 
a calendar independent of any digital media files, by disclosing that users may specify 
appointments, meetings, etc. [paragraph 5] which are marked on the calendar to allow 
users to easily track important events [paragraph 42]. Information stored in a calendar 
system database is utilized as well as information determined by similarity and chunking 
system to display different levels of time-based information relating the user computer 
activities and files [paragraph 33]. 

Vronay teaches determining a manner in which the media file will be represented 
in a media view of the media diary and presenting the media file as a media file 
representation in the media view in accordance with the correlation procedure and the 
determination of the manner of representation, by disclosing that photos may be 
searched for and presented as shown in [figures 5-11]. 
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The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38] The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment] Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
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Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

Regarding claim 33, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining the size of a thumbnail 
representing the media file, by disclosing that as the views are enlarged, the 
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arrangement of graphical objects within each calendar day is updated to take advantage 
of the available display space [Adcock, paragraph 35]. 

Regarding claim 34, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining a size of a date column 
that the representation will reside in, by disclosing that calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 

Regarding claim 35, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining the size of the media view 
in proportion to the overall viewing area, by disclosing that calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 

Regarding claim 36, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining a quantity of the media 
files represented in a date column, by disclosing that as the views are enlarged, the 
arrangement of graphical objects within each calendar day is updated to take advantage 
of the available display space [Adcock, paragraph 35]. The calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 
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Regarding claim 46, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein said correlating the metadata information with calendar event information 
includes automatically correlating the metadata information with calendar event 
information, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39]. 

Claims 37, 40, 41, 47 

Regarding claim 37, Vronay discloses an apparatus comprising: a processor and 
memory including computer program code, the memory and computer program code 
configured to, with the processor, cause the apparatus to at least receive manual input 
creating an event, by disclosing a calendar-based user interface that improves user 
accessibility of information from a computer [paragraph 1]. Users may specify 
appointments, meetings, etc. [paragraph 5] which are marked on the calendar to allow 
users to easily track important events [paragraph 42]. 

Vronay teaches generating a calendar view that represents time in calendar 
format and visually associates events with respective periods of time, at least one of the 
events being created and represented in the calendar view independent of any digital 
media files, by disclosing displaying visualizations to distinguish events on a calendar 
[paragraphs 37-43]. 
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Vronay teaches generating a media view that provides access to digital media 
files and associates digital media files with a period of time, by disclosing that photos 
may be searched for and accessed [paragraph 65]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
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to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 1 1], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 
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Regarding claim 40, Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, wherein the processor is further configured to search the calendar view and 
the media view in terms of time period, by disclosing searching based on dates [Vronay, 
figure 5; Adcock, paragraph 36] 

Regarding claim 41 , Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, further comprising a display in communication with the processor that 
presents, independently, the calendar view and the media view, by disclosing [Adcock, 
figure 7]. 

Regarding claim 47, Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, wherein said processor is further configured to automatically correlate 
respective metadata information of the media file and calendar events, at least one of 
the calendar events being created and represented in the calendar view independent of 
any digital media files, by disclosing automatically associating digital images with an 
event or date [Adcock, paragraph 39]. 

Claim 25 is rejected under 35 U.S.C. 103(a) as being unpatentable over Vronay 
et al (Pub. No. US 2003/0156138 A1), in view of Temple ("The Complete Idiot's Guide 
to Microsoft Outlook 2000", May 1999), in view of Adcock et al (Pub. No. US 
2004/01 251 50 A1 ), and further in view of Hullot et al (Pub. No. US 2004/01 09025 A1 ). 
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Regarding claim 25, Vronay and Adcock disclose the method of claim 22. Vronay 
and Adcock do not expressly teach wherein the providing the user access to the digital 
media file via a timeline view that combines a timeline with the media view and a 
calendar view of calendared events further comprises providing the user access to the 
digital media file via a timeline view that combines a scrollable timeline with the media 
view and a calendar view of calendared events. Hullot discloses a calendar with a 
scrollable timeline as shown in [figure 9]. It would have been obvious to one of ordinary 
skill in the art at the time the invention was made to include a scrollable timeline, as 
taught by Hullot, in the calendar interface of Vronay and Adcock. This would allow users 
to view times that cannot be fit into the display. 

(10) Response to Argument 

A. Appellant's argument that claims 1 , 2, 4-22, 26-37 and 40-47 are patentable over 
Vronay, Temple, and Adcock 

Regarding independent claims 1, 20, 22, 26, 32, and 37, the Appellant alleges 
that Vronay et al (Pub. No. US 2003/0156138 A1) does not explicitly teach, "at least one 
manually entered event scheduled at a future time," and particularly that the events 
described in Vronay are not manually created events [see Appellant's brief page 7, 
paragraph 3]. Contrary to Appellant's arguments, although Vronay does disclose using 
a calendar as a dynamic application that does not require direct user input [Vronay, 
paragraph 7], such a statement does not preclude the use of manually created events in 
addition to the tracking of time-related events as described in [Vronay, paragraph 5]. 
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Vronay discloses that the calendar user interface system would provide and include 
standard calendar operations, similar to the calendar in numerous conventional 
calendar programs [Vronay, paragraph 35]. Conventional computer calendars allow for 
user-specified appointments, meetings, etc. to be added or entered manually rVronav, 
paragraph 51 . These events are marked on the calendar to allow users to easily track 
important events [Vronay, paragraph 42]. The user computer activities may be in the 
future [Vronay. paragraph 381. Thus, Vronay discloses manually adding user-specified 
appointments for a future date. Additionally, the manual creation as described in 
[Vronay. paragraphs 35. 51 must be for future events since if monitoring of events is 
strictly done without user input and based solely on data collection of activities carried 
out on a computing device, there would be no way for the computer to create the future 
events as described in [Vronay. paragraph 381 . 

Appellant alleges that Vronay in view of Temple fails to provide the calendar view 
including at least one manually entered past event and at least one manually entered 
event scheduled at a future time in a combined calendar view and media view [see 
Appellant's brief, page 8, paragraph 3]. Examiner notes that nothing within independent 
claims 1 , 20, 22, 26, 32, and 37 recite that the event associated with the multiple media 
file representations is the manually entered past or future event. Contrary to Appellant's 
arguments, as discussed above, Vronay discloses that users can manually create future 
events. Vronay also discloses simultaneously presenting the calendar view with a list of 
times and corresponding accessible media [paragraph 65, figure 11] Thus, the 
combined calendar and media view may have a manually entered future event. Vronay 



Application/Control Number: 1 0/71 5,1 87 Page 33 

Art Unit: 2172 

does not explicitly teach the calendar view including at least one manually entered past 
event. Temple discloses adding appointments to a calendar in Microsoft Outlook 2000 
[page 196, Adding an Appointment]. Users can enter the date and time for an 
appointment, which may be a past date [page 198, When?; page 200, Other Ways to 
Add Appointments]. Since Vronay discloses providing and including standard calendar 
operations, similar to the calendar in numerous conventional calendar programs 
[Vronay, paragraph 35], it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to allow users to manual enter an event in the past, as 
taught by Temple. This would provide added flexibility in scheduling events. 

Appellant alleges that the reasoning provided for making the combination of 
Vronay in view of Temple has nothing to do with the presentation of media files in a 
combined calendar view and media view. Contrary to Appellant's arguments, Vronay 
discloses providing standard calendar operations, similar to the calendar in numerous 
conventional calendar programs [Vronay, paragraph 35] which include user-specified 
appointments entered manually [Vronay, paragraph 5] in the calendar view with a list of 
times and corresponding accessible media [Vronay, paragraph 65, figure 1 1]. It would 
be advantageous to allow users the flexibility of scheduling events in the past, as taught 
by Temple. Just because an event may have already passed does not automatically 
render scheduling the past event moot. The user may want the flexibility of scheduling 
past events so they can track the history of events that have already occurred. Thus, it 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to allow users to manual enter an event in the past, as taught by Temple. 
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Appellant alleges that Vronay and Temple fail to provide any teaching or 
suggestion of, " multiple media file representations that are enabled to be displayed in a 
corresponding period of time segment of the timeline view along with a text 
identification of an event associated with the multiple media file representations 

[see Appellant's brief page 8, paragraph 2; page 9, paragraph 2]. Examiner notes that 
this limitation has been rejected under Vronay, in view of Temple ("The Complete Idiot's 
Guide to Microsoft Outlook 2000", May 1999), and further in view of Adcock (Pub. No. 
US 2004/01 251 50 A1 ). Examiner notes that the claim does not recite where the text 
identification is displayed. The claim only recites that the text identification is displayed 
along with the multiple media file representations. Contrary to Appellant's arguments, 
Adcock discloses a calendar based graphical user interface for displaying digital images 
[Adcock, paragraph 1]. Graphical objects representing digital images are displayed 
within a calendar view having a timeline [Adcock, figures 4, 5]. Digital images are 
accessible for detailed viewing or editing by selection of a displayed graphical object in 
the calendar [Adcock, paragraph 35]. Images for an event may be grouped together 
I Adcock, paragraph 371 and associated with an event identifier f Adcock, paragraph 40; 
figure 71. The graphical objects within the month views shown in [Adcock, figure 7] are 
similar to the graphical objects in [Adcock, figure 4]. Thus, the pop-up window shown in 
[figure 7] may be considered a text identification of an event associated with multiple 
media file representations. Additionally, event groups in the graphical object display 
window may be separated/identified by a placeholder containing information for the 
associated event [Adcock, paragraph 421. As shown in [figure 7, 721b,' 731b,"741b,' 
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75767, text may be displayed within these placeholders . This allows users to more 
efficiently browse images [Adcock, paragraph 3]. Since Vronay discloses the need to 
better locate and retrieve computer information such as files, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to use the 
interface of Adcock for browsing the calendar-based interface of Vronay. This would 
allow users to more efficiently browse images. 

Appellant states that dependent claims 2, 4-19, 21 , 27-31 , 33-36, and 40-47 
recite all the limitations of the independent claims, and thus, are allowable in view of the 
remarks set forth regarding independent claims 1 , 20, 22, 26, 32, and 37. However, as 
discussed above, Vronay, in view of Temple, and further in view of Adcock are 
considered to teach claims 1 , 20, 22, 26, 32, and 37, and consequently, claims 2, 4-19, 
21 , 27-31 , 33-36, and 40-47 are rejected. 

B. Appellant's argument that claim 25 is patentable over Vronay. Temple. Adcock. and 
Hullot 

Appellant states that dependent claim 25 recites all the limitations of the 
independent claim, and thus, is allowable in view of the remarks set forth regarding 
independent claim 22. However, as discussed above, Vronay, in view of Temple, and 
further in view of Adcock are considered to teach claim 22, and consequently, claim 25 
is rejected. 



(11) Related Proceeding(s) Appendix 
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No decision rendered by a court or the Board is identified by the examiner in the 
Related Appeals and Interferences section of this examiner's answer. 
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For the above reasons, it is believed that the rejections should be sustained. 
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